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Abstract 

This paper proposes new notions of polynomial depth (called monotone poly depth), 
based on a polynomial version of monotone Kolmogorov complexity. We show that mono- 
tone poly depth satisfies all desirable properties of depth notions i.e., both trivial and 
random sequences are not monotone poly deep, monotone poly depth satisfies the slow 
growth law i.e., no simple process can transform a non deep sequence into a deep one, 
and monotone poly deep sequences exist (unconditionally). 

We give two natural examples of deep sets, by showing that both the set of Levin- 
random strings and the set of Kolmogorov random strings are monotone poly deep. 

1 Introduction 

Prom the observation that nature contains both very simple and highly complex structures, 
Bennett introduced the profound concept of logical depth [7J, as a formal definition of useful 
information, as opposed to (random) information in the traditional algorithmic information 
theory sense. Bennett's original idea is to categorize structures in three groups: trivial, 
random and the remaining ones; with the idea that trivial structures being completely pre- 
dictable contain no useful information; random ones, being completely unpredictable, do not 
contain any useful information either; both (trivial and random) being therefore shallow ob- 
jects. On the other hand, structures that are neither random nor trivial i.e., that contain 
intricate patterns that are neither fully predictable nor completely unpredictable, contain 
useful information; they are called deep structures. Although random sequences contain a 
lot of information (in the sense of algorithmic information theory), this information is not of 
much value, and such sequences are shallow. 

Bennett observed that deep objects, because they contain complex well-hidden patterns, 
cannot be created by easy processes. This observation was formalized in the so-called slow 
growth law, which states that if a simple process (a truth table reduction) transforms some 
(source) sequence into an (image) sequence that is deep, then the source sequence it started 
from must be deep i.e., no easy process can transform a shallow sequence into a deep one. 

Bennett's logical depth is based on Kolmogorov complexity. Intuitively, a binary sequence 
is deep, if the more time an algorithm is given, the better it can compress the sequence. 
Although Bennett's formulation is theoretically very elegant, it is uncomputable, due the 
uncomputability of Kolmogorov complexity. 

To overcome the uncomputability of logical depth, several notions of feasible depth have 
been proposed so far |1H [5l [9]. In [5] Antunes, Fortnow, van Melkebeek, and Vinodchan- 
dran studied several polynomial-time formulations of depth, with connections to average-case 



'Department of Computer Science, National University of Ireland Maynooth, Maynooth, Co. Kildare, 
Ireland. 



1 



complexity, nonuniform circuit complexity, and efficient search for satisfying assignments to 
Boolean formulas. In [S], both a notion of finite-state and polynomial depth were investigated, 
and the depth of polynomial weakly useful languages was shown. 

Unfortunately, the feasible notions proposed so far suffer some limitations, e.g. a notion 
in ^5J requires a complexity assumptions to prove the existence of deep sequences; and the 
polynomial depth of [9j is based on polynomial time predictors that cannot read their input 
(predictors must predict the nth bit of a sequence without access to the history, i.e. bits 
l,2,...,n-l). 

As noticed in [15], depth is not an absolute concept, but depends on the power of two 
competing group of observers A and A'. Informally a sequence is (A,A')-deep if for any 
observer O from A there is an observer O' in A' such that O' performs (e.g. compresses, 
predicts, etc.) better than O' on the sequence. A and A' can be the same class e.g. for 
recursive depth |11] . A = A' are recursive time bounds, or different classes e.g. for Bennett's 
depth [7], A are recursive time bounds but A' is unbounded Kolmogorov complexity. 

In this paper, we use the idea of competing observers from [15] to construct new notions of 
polynomial depth (called monotone-polynomial depth), aiming at notions that satisfy the slow 
growth law, and for which deep objects can be proved to exist unconditionally. The classes of 
observers (the classes A and A') we consider are based on the notion of monotone polynomial 
time compression [8], which is a polynomial version of monotone Kolmogorov complexity, 
with the advantage that unlike polynomial predictors [9j, monotone polynomial compressors 
can read their input. We show that our notions of monotone polynomial depth have all the 
desired properties of a depth notion, i.e. both trivial and random sequences are shallow, they 
satisfy a slow-growth law, and deep objects can be shown to exist unconditionally. 

Although logical depth is a very profound concept, there have not been many examples of 
natural deep sequences in the literature so far. Bennett [7] showed that the halting language 
is deep. Lathrop and Lutz |10] generalized Bennett's result by showing that every weakly 
useful sequence (i.e. a sequence such that the set of languages that can be reduced to it 
has measure non-zero) is deep, a result that was shown to hold in the context of polynomial 
depth [9]. In this paper, we give two natural examples of deep languages, in the context of 
monotone poly depth, namely the set of Levin-random strings and the set of Kolmogorov 
random strings. Levin randomness is a standard randomness notion due to Levin [12] ; it is 
a computable approximation of Kolmogorov complexity, that enjoys many useful properties, 
among others it provides a search strategy for finding solutions of NP problems, that is 
optimal up to a multiplicative constant (see [l3]). Curiously although random sequences are 
shallow, our result shows that the set of Levin-random strings is not. This shows that in the 
context of polynomial monotone depth, having a test that detects randomness (i.e the set of 
Levin-random strings), is more useful than having access to randomness (a random sequence). 

Several authors [21 HI [U [3] showed the computational power of the set of Kolmogorov 
random strings by reducing (using several types of reduction) a broad range of complexity 
classes to it. Our observation that the set of Kolmogorov random strings is monotone-poly 
deep is consistent with the results by these authors [21 H] (U [3] whose results intuitively show 
that this set contains a lot of useful information. 

Due to lack of space, some proofs are postponed to the appendix. 
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2 Preliminaries 



We write N for the set of all nonnegative integers. Let us fix some notations for strings and 
languages. A string is an element of {0, 1}" for some integer n. We denote by sq, si, . . . ,Sn the 
standard enumeration of strings in lexicographic order. For a string x, its length is denoted 
by \x\. The empty string is denoted by A. We say string y is a prefix of string x, denoted 
y \Z X (also y ^ x), if there exists a string a such that x = ya. We write x ~ y if x is a prefix 
of y or vice-versa. For a string x, dbl(x) is x with every bit doubled. 

A sequence is an infinite binary string, i.e. an element of {0, 1}°°. For S € {0, 1}°° and 
i,j G N, we write 5'[i..j] for the string consisting of the i^^ through j^^ bits of S, with the 
convention that S[i..j] = A if i > j, and ^[l] is the leftmost bit of S. We write S[i] for S[i..i] 
(the i*^ bit of S). For a sequence S divided into blocks S = S1S2SS . . ., where Si are strings, 
S \ Si (resp S ] Si) denotes Si ... Si (resp. 5i . . . Si^i). For w € {0, 1}* and S G {0, 1}°°, we 
write w ^ S ii w is a prefix of S, i.e., if w = S[l..\w\]. Unless otherwise specified, logarithms 
are taken in base 2. 

A language is a set of strings. The characteristic sequence of a language L is the sequence 
XL G {0, 1}°°, whose nth bit is one iff s„ G L. We will often use the notation L for XL- 

TM stands for Turing machine. A monotone TM is a TM such that for any strings x, y, 
M{xy) □ M{x). 

E denotes the standard linear exponential time complexity class E = UceNDTIME(2'^"). A 
time bound is a monotone time constructible function t : N — )• N, i.e. there is a TM that 
on input any string of length n halts in exactly t{n) steps. We will consider the following 
standard time bound families: Poly = UfcgN{i('i-) = kn^}, Lin = UfcgN{i("') = kn\, Polylog = 
UfcgN{t(n) = log'^' n} and Rec = {t\ t is a time bound}. 

3 Polynomial depth 



Our polynomial depth notions are based on polynomial monotone compression from [8' 



Definition 3.1 Let A be a family of (at least linear) time bounds (e.g. Poly, Lin, etc) and 
S G {0, 1}°°. A A- compression of S is a 3-tuple (C, D,p) where C, D are TMs andp G {0, 1}°° 
such that there exists a time bound t G A such that 

1. Decompression: For all j G N, D{p[l..j]) outputs S[l..iD.j] in time t{i + j), where i^j 
is a monotone sequence of integers. 

2. Compression: For all i G N, C{S[l..i]) outputs several strings in time t{i), one of which 
is a prefix p' of p, .such that D{p') □ S'[l..i]. 

The integer io^j is the number of bits the decompressor D can output given i bits of input 
i.e., the larger the difference iD,j — j the greater the compression. 

When A = Rec, we drop the compression requirement, i.e. a Rec-compression is a 2-tuple 
(D,p). This is because the compressor C may be uncomputable. When A = Rec we are in 
the realms of Kolmogorov complexity, where similarly there is no (computable) compressor 
but only a computable decompressor (the universal TM U). 

...2" 

To avoid extreme compressions of the form "On input n, output 2^ zeroes", we fix 
the maximal compression factor we allow i.e., let MD (maximal decompression) be a function 
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such that MD{j) is computable in 0(MD(j)) time for any integer j (e.g. MD(j) = 2 ). We 
require that for any A-compression {C,D,p), and for every integer j, 

iD,j < MD(j) 

i.e. MD is the same for all compressors. 

Let us introduce our (A, A')-depth notion, based on competing observers' classes A and 

A'. 

Definition 3.2 S E {0,1}°° is a.e. (resp i.o.) {A,A')-deep if for every A-compression 
{C,D,p) of S and any a > 0, there exists a A' -compression (C',D',p') of S such that for 
almost every (resp. infinitely many) j G N 

iD',j - iD,j > alogiD'j- (1) 

A sequence is (A, A')-shallow if it is not (A, A')-deep. 

The choice of the log function in Equation [1] is arbitrary. In Bennett's original notion [7], 
it was only required the difference be unbounded and the rate was not specified, but Bennett's 
notion would also work with a log rate function. Most feasible depth notions published after 
Bennett's paper O [U] used a logarithmic rate function. We choose to do the same. 

As noticed in [15], the notion of depth is a relative notion, that depends on the power of 
the observers. Our goal is to study polynomial versions of Bennett's original depth notion 
[3, and its recursive version called recursive depth [11] . Recursive depth [llj is defined in 
terms of recursive observers competing against recursive observers, i.e. A and A' have the 
same power. The natural polynomial version is to choose A = A' = Poly. We call this notion 
monotone- Poly-depth. 

Bennett's depth |7] on the other hand is based on observers of different strength i.e., 
recursive observers competing against noncomputable Kolmogorov complexity. For Bennett's 
notion, there is no unique translation into the polynomial world. We propose to study (A = 
Lin, A' = Poly) as a polynomial version of Bennett's depth (called monotone-Lin-depth), 
which encompasses the idea of observers of different strength (Lin vs Poly), but keeping both 
in the polynomial setting. The choice (A = Lin, A' = Poly) is actually flexible, and Poly 
(resp. Lin) could be replaced by anything strictly stronger (resp. weaker ) than Lin, e.g. 
O(n^) (resp. Poly log), without modifying our results on monotone-Lin-depth from Section 
[5] (the choice A =Polylog, would require a modification of the notion of A-compression [8] 
to allow for sublinear running time, in the same way as martingales where modified to allow 
sublinear time bounds in [16]. We defer this generalization to the full version of this paper). 
The choice Lin vs Poly somehow reflects the difference in power of complexity classes E and 
EXP, which are the complexity classes on which A-compression was first introduced [8], to 
define a measure notion. 

In |5] Antunes et al. proposed another resource-bounded version of Bennett's depth [7] 
called basic computational depth, by looking at bounded (sublinear or polynomial) Kol- 
mogorov complexity vs unbounded Kolmogorov complexity. We introduce a translation of 
basic computational depth [5j in the setting of polynomial monotone compressors, by choos- 
ing (A = Poly, A' = Rec). We call this notion basic-monotone- Poly-depth (bm- Poly-depth) . 
bm-Poly-depth captures the idea behind basic computational depth [5] but with Kolmogorov 
complexity replaced by monotone compressors. 
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The difference between a.e. and i.o. depth is similar to the difference between (resource- 
bounded)-packing dimension and (resource-bounded)-dimension (see e.g. [B]), where a com- 
pressor is required to compress infinitely many prefixes, or almost all prefixes. Bennett's 
depth [7] is an a.e. notion. Sometimes when the observers are very weak e.g. finite-state, 
i.o. is the best achievable (e.g. see [9]). All our results use the stronger formulation i.e. a.e. 
(which implies an i.o. result), except Theorem 14.41 

4 Basic properties of monotone-Poly-depth 

In the next section we study the basic properties of monotone-Poly-depth. All results remain 
true for both monotone-Lin-depth and bm-Poly-depth. 

It is a key feature of logical depth [7| that both trivial (recursive) and random sequences 
are shallow. In this section we show that a similar result holds in the context of monotone- 
Poly-depth. Let us define what is meant by trivial sequences in the context of polynomial 
depth. Informally a sequence is trivial if its prefixes can be maximally compressed. 

Definition 4.1 Let S € {0,1}°°. S is Poly- optimally- compressible if there exists a Poly- 
compression {C,D,p) of S, such that i£)j = MD(j) for almost every j € N. 

As an example, it is easy to check that the characteristic sequences of languages in E are Poly- 
optimally-compressible. The following result shows that optimally-compressible sequences are 
shallow. 

Theorem 4.1 Every Poly- optimally- compressible sequence is a.e. Poly-shallow. 

On the other extremity of the scale of randomness, we have random sequences. Here is a 
definition in the context of polynomial depth. 

Definition 4.2 Let S E {0,1}°°. S is Poly-random if for every Poly- compression (C,D,p) 
of S, there exists c G N such that for almost every j G N 

ioj <j + c. 

The following result shows that random sequences are shallow. 
Theorem 4.2 Every Poly-random sequence is a.e. Poly- shallow. 

4.1 Slow growth law 

A key property of logical depth [7], is that depth cannot be easily created. The formalization 
of this idea is known as the slow-growth law. It states that if a simple process transforms 
some (source) sequence into an (image) sequence that is deep, then the source sequence it 
started from must be deep i.e., no easy process can transform a shallow sequence into a deep 
one. Bennett proved a slow growth law for truth-table reductions (i.e. in the context of logical 
depth, simple process corresponds to truth-table reductions). 

In the following section, we prove a slow growth law in the context of monotone-Poly- 
depth. As the power of polynomial monotone compressors is much smaller than the un- 
bounded time case considered for Bennett's logical depth, we need to reduce the power of 
"simple processes" accordingly, by choosing weaker reductions. Here is a definition. 
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Definition 4.3 Let S,T {0,1}°°. S is Poly-monotone reducible to T, if there exists a 
Poly-time monotone TM M such that 

1. Reduction: for every n € N, M{T[l..n]) IZ S. 

2. Honesty: There exists a > such that for every n E N 

n — alogn < |M(T[l..n])| < n + alogn 

3. Monotone injectivity: If M{x) ~ M(y) then x ^ y. 

The following result is a slow-growth law for monotone-Poly-depth. A similar result holds for 
both monotone-Lin-depth and bm-Poly-depth (provided the reduction is linear-time bounded 
for monotone-Lin-depth) . 

Theorem 4.3 Let S,T G {0, 1}°°, such that S is a.e. monotone- Poly- deep and Poly-monotone 
reducible to T. Then T is a.e. Poly-deep. 

A similar proof shows that the result holds for both monotone-Lin-depth and bm-Poly- 
depth (provided the reduction is linear-time bounded for monotone-Lin-depth). 

4.2 A Poly deep sequence 

Some previous polynomial depth notions (e.g. distinguishing complexity from [S]) require 
complexity assumption to prove the existence of deep sequences. The following result shows 
that our notion is unconditional. Similarly to other feasible depth notions with restricted 
power [9], our result is an i.o. result. 

The proof uses the equivalence between compressors and martingales from [8j. A direct 
proof can be given without martingales, but using martingales makes the proof easier to read 
since it is easier to sum and diagonalize against martingales than it is against compressors 
directly. It is also interesting to see the correspondence martingales-compressor in the context 
of depth. 

Theorem 4.4 There exists an i.o. monotone- Poly- deep sequence. 

5 The set of Levin random strings is deep 

Whereas random sequences are shallow, we show that the characteristic sequence of the set 
of random strings is deep. Our result holds for the standard randomness notion due to Levin 
|12j : Levin's notion is a computable approximation of Kolmogorov complexity, that enjoys 
many useful properties, among others it provides a search strategy for finding solutions of NP 
problems, that is optimal up to a multiplicative constant (see ^3j). Here is a definition. 

Definition 5.1 Fix a universal Turing machine U . The Levin complexity of a string x is 
Kt(x) = min{|p| + logt : U{p) = x in at most t steps}. 
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The definition of Kt does not depend on the choice of the universal TM U, up to an additive 
constant (see [I3J). 

The set of Levin random strings is 

i?Kt = {x£ {0, 1}* : Kt(x) > |x| + log (2) 

By a standard program counting argument, it is easy to see that Rki 7^ 0- Although the 
strings in i?Kt are shallow, the characteristic sequence of i^Kt contains useful information, i.e. 
is monotone-Lin-deep, as the following result shows. 

Theorem 5.1 R^t is a.e. monotone- Lin- deep. 

Proof. We need the following lemma. 

Lemma 5.1 For every Lin- compression {C,D,p) and for almost every j G N 

in, < 2'''+\ 

Let us prove the lemma by contradiction. Suppose there is an infinite set J of integers j such 
that in^j > 2^^^"*"^; in particular for every j € J, ij^ iwi > 2-'^-'^. Thus 

'3 " 

RKt □ D{p[l.hog3]) □ i?Kt[1..2^+^]. 

Let j G J be large (to be determined later). Letting d = p[l..\ log j] yields a string with high 
Kt complexity: from vr = {D,d) recover i2Kt[l--2-''''^] and j (from the length of d). Output 
the first y with \y \ = j and Rmiy) = 1, i-e. 

Kt(y) >j + logj. 

By encoding vr the standard way, i.e. tt = dhl{{D))01d 

kl < Ml + 0(1) < ^iogi + o(i). 

The time to construct j is the time to recover i?Kt[l--2-'^^] (less than 0(2-^^"'^)) and the time 
to find y in i?Kt[l--2-'^"'^] (less than 0(2-'"'"-'^) steps), i.e. a total of at most 0(2-'+^) steps. 
Therefore 

Kt(y) < |7r|+ log 0(2^+1) < i logj + j + 0(1) < j + log j 
for j large enough, which contradicts RKtiv) = 1; thus ending the proof of the lemma. □ 

Lemma 5.2 There exists a Poly- compression {C,D,p) of R}<it such that for almost every 
j G N 

iD,j=MD{j). 

Let p = 0°°. D on input p[l.-j] computes inj '■= MD(j). D constructs i?Kt[l--^Dj] by 
simulating the universal TM on all programs tti of size at most logi^j + loglogi£)j- during t; 
steps {ti < 2^°§'^'J+'°s^°g'o,j^^ iiiQ results string of such a simulation is denoted xi. All strings 
xi with \xi\ < logiDj, for which Ivr^l + logt; < jx^j + log jx^j have membership bit in the 
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characteristic sequence i?Kt[l--»D,j]- All remaining bits in i?Kt[l--^D,j] are Is. The running 
time of D is less than 

for some c G N. 

The compressor C on input i?Kt[l--^] finds the smallest j such that MD(j) > i, and outputs 
O-'. C runs in time polynomial in i. This ends the proof of the lemma. □ 

Let us show that i?Kt is monotone-Lin-deep. Let a > and (C, D^p) be a Lin-compression 
of -RKt) and let (C , D' ,p') be the Poly-compression from Lemma l5.2i We have 



^D'j ~ '^-Dj = MD(j) — iDj by Lemma 

> MD(j) - 2^'"+^ by Lemma [52 



> ^MD(j) by definition of MD 

= 2^D',j by definition of i^'j 

> alogio'j 

for almost every j i.e. Rki is monotone-Lin-deep. 

6 The set of Kolmogorov-random strings is deep 

The next result shows that the set of Kolmogorov random strings is bm- Poly-deep. 

Definition 6.1 Fix a universal Turing machine U. The Kolmogorov complexity of x is the 
length of the shortest program that outputs x. 

K{x) = min{|p| : U{p) = x}. 

The definition of K does not depend on the choice of the universal TM U, up to an additive 
constant (see [13]). 

For a time bound t, the t-bounded Kolmogorov complexity of x is 

K^{x) = min{|p| : U{p) = x, and U halts in at most t{\x\) steps}. 

Let < e < 1. The set of Kolmogorov random string is 

RK,e = {x£ {0, 1}* : K{x) > e\x\}. (3) 

Theorem 6.1 Let < e < 1. RK,e is a.e. hm- Poly- deep. 

Proof. Let < e < 1 We need the following lemma. 

Lemma 6.1 For every Poly- compression {C,D,p) of RK,t and for almost every j G N 
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Let us prove the lemma by contradiction. Suppose there is a Poly-compression {C,D,p) of 
RK,e and an infinite set N of integers j such that idj > 2^^^. Let c = 4/(1 — e) and j G N. 

Let yi, . . . ,?/c G {0, Ip such that K"^" {{yi, . . . ,7/^)) > cj - 0(log j) but K{{yi, . . . ,y^)) < 
0(log j). Such a c-tuple can be found by simulating U on all programs of appropriate size 
running in at most 2" steps. We have RK,e{yt) = for every t = I, . . . ,c. 

Consider L = {{h,--- Jc)\ 1 < k < 2<^+'^\ t = l,...,c}. Let Q = {qi\l G L} with 
qi = {code,p[l..j],l) be the set of programs such that U on input qi simulates D{p[l..j]) to 
reconstruct RK,e[^--iD,j] 3 RK,e[^--'2-^~^^], which takes time less than 0{2^) {U stops once D 
already output the 2^~^^ first bits of RK,e)- U constructs 

i?o = {n < r2 < . . . I n € {0, 1}^^,RkM) = 0} 

the lexicographical ordered set of all strings of length at most j whose characteristic bit in 
RK,e is 0, which takes time 0{2^). If Hj,--- ,r/^ € Rq then output {ri^,--- ,ri^) else halt, 
which takes time 0{2^). 

On any program qi G Q, U runs in less than 2'-^^^^ steps. Moreover all It {t = 1, . . . ,c) can 
be encoded in at most e(j + 1) bits i.e., all programs qi G Q have size bounded by 

\qi\ < ce{j + + O(logj) < (ce + l)j + O(logi). 

Because RK,t{yt) = for every t = 1, . . . , c, let v = {vi, . . . , Vc) G L he the vector of the 
positions of yi, . . . , yc in RK,e i-e., r^^ = yt for every t = 1, . . . , c. Thus U on input q^ outputs 
(yi, . . . ,yc) i.e., q^ is a program for (yi, . . . ,yc) that runs in less than 2'^(-'^ steps. Thus we 
have ^ 

i^^" ((yi, . . . , yc)) < (ce + l)j + 0(log j) which implies 

cj - 0(log j) < (ce + l)j + 0(log j) i.e., 

cj < (ce + l)i + O(logi) < (ce + 2)j 

thus c(l — e) < 2 which is a contradiction. □ 

Lemma 6.2 There exists a Rec- compression {D,p) of Rx^e such that for almost every j E N 

2-'+^ > ioj > 2^/'. 

Let p = r2[l..n] be the halting probability Q = Ylp-u{p)i 2~'^'- D on input p[l..ej] can compute 
using standard Dove-tailing (see |13) ) whether U{p) J, for all programs p with \p\ < ej i.e., 
it can reconstruct Rk,€[^--2^~^^ — 1]. We have iD,ej ^ 2^ i.e., ioj > 2-'/"^. By construction 
2^'+^ > «Dj ' ' ' □ 

Let us show that RK,e is bm- Poly-deep. Let a > and (C, be a Poly-compression of 
RK,e, and let {D' ,p') be the Rec-compression from Lemma 16.21 We have 



iD',j — inj > 2^^^ — ijjj by Lemma [62] 

>2J A-2^+^ by Lemma O 

= 2^'(2(^/'-^)-'' - 2) 

> 2-''''^ for j large enough 

> i /)/ ,,■ by Lemma 16.21 

> alogiD'j 

for almost every j i.e. i?_ft-,e is a.e. bm-Poly-deep. □ 
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A Appendix 

Proof, (of Thm HTT]) Let 5 be a Poly-optimally-compressible sequence, and let {Cq, Dq,po) 
be a Poly-compressor witnessing this fact. By definition, S is Poly-shallow if there exists a 
Poly-compression {C,D,p) of S and a > 0, such that for any Poly-compression (C , D' ,p') of 
S, and for infinitely many j GN 

Letting a = 1 and (C, D,p) = (Co, DqiPo) implies that for almost every j € N, i/jj = MD(j). 
Let (C, D',p') be any Poly-compression of 5", then for almost every j G N 

- iD,j < MD(j) - iDj = MD(i) - MD(i) = < logiD'j- 

□ 

Proof, (of Theorem 14. 2p Let S" be a Poly-random sequence, and let {C,D,p) be the identity 
compressor i.e. p = S and C{x) = D[x) = x for any string x (in particular i^j = j). Let 
a = 1. Let us show that for any Poly-compression (C , D' ,p') of S, and for infinitely many 

j eN 

Let {C , D' ,p') be any Poly-compression of S; then there exists c G N such that for almost 
every j £ N, iD'j — j < c. Thus 

in'j - iD,j = iD'j - j < c< logiD'j 

for almost every j G N. □ 
Proof, (of Theorem l4.3p Let S, T be as above, and let M denote the Poly-monotone reduction. 
We need the following result that shows that M can be inverted in polynomial time. 

Lemma A.l Let M be as above. Then there is a polynomial TM N such that for every string 
X, N{M{x)) = x' , with x' □ x, and M{x') = M{x) (and x' is maximal i.e., Vy € {0,1}*, 
M{x'y) / M{x')). 

Let us prove the lemma. Let M be as above, let x,y £ {0, 1}* such that M(x) = y, \x\ = n, 
\y\ = m. Let c be given by honesty of M, thus 

n — clogn < \y\ < n + clogn which implies (4) 

— clog n < n < |y| + clog n and 

log — < log(n — clog n) < log |y| i.e. 

log n < 2 log \y\. 

Therefore 

\y\ — 2c log |y| < n < \y\ + 2c log \y\. (5) 

String X is constructed recursively, by groups of logm bits at a time, i.e we construct xi C 
X2 C . . . such that the final Xf will be the promised x' . The construction is a follows, suppose 
xi n X2 \Z . . . \Z Xi have already been constructed. We construct Xj+i as follows; try all m 
strings z G {0, iy°s"^ to find the unique z such that M{xiz) IZ y, and let Xj+i = XiZ. z is 
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unique; suppose by contradiction that there are z^z' such that M{xiZ^ IZ y and M(xiz') IZ y 
i.e. M{xiz) ~ M{xiz'), thus by monotone injectivity, XiZ ~ Xiz', implying z = z' (since 
\z\ = \z'\). The procedure is carried on until with |a:/_i| = \y\ — 2clog|y|. Finally all 
extensions z G {0, l?^! are tested to find the longest such z such that M{xf-iz) = y. 

By Equation [5] such a z exists, and letting x' = Xf-iz, guarantees that x' is maximal. As 
both the number of extensions to test during the whole constructions of x' and the number 
of steps 1, . . . , / is polynomial in \y\, N runs in polynomial time; which ends the proof of the 
lemma. □ 
Let us show that T is Poly-deep; let a > and (C, D,p) be a Poly-compression of T. This 
induces a Poly-compression {Ci, Di,p) for S, with Di = M o D and Ci = C o N . Ci,Di run 
in Poly-time. For any j, n € N we have 

Di{p[l..j]) = M{T[l..iD,j]) □ S[l..iD,j - clogiDj] 
by Equation m which implies 

iouj >^D,j - clogiDj- (6) 

Also 

Ci{S[l..n]) = Co N{S[l..n]) = C{T[l..m]) 

with Af(r[l..m]) = S'[l..n], and C{T[l..m]) outputs several strings one of which is a prefix x 
of p, such that 

T □ D{x) □ T[l..m]. 

Thus 

Di{x) = M{D{x)) □ M{T[l..m]) = S[l..n]. 

Let 6 = 2a + 6c > 0. Since S is Poly-deep, there exists a Poly-compression {C2, D2,P2) 
for S such that for every j G N 

«D2,j - iDuj > ftloglDaj- (7) 

We construct a Poly-compression (C, D',p2) oiT with D' = N0D2 and C" = C2 o Af. C", D' 
run in Poly-time. For any j, n G N we have 

D'{p2[l..j]) = N{S[l..iD,,j]) □ T[l..iD,,j - 2c\ogiD,,j] 

implying 

iD',j > iD2,j - 2clogZD2,i (8) 

and 

C'{T[l..n]) = C2{M(T[l..n])) = C2{S[l..n']) 

where n' is an integer such that n' > n — clogn, N{S[l..n']) □ T[l..n] and C2{S[l..n']) outputs 
several strings one of which is a prefix x' of p2, such that 

SnD2{x') □ S[l..n']. 

Thus 

D'{x') □ N{S[l..n']) □ r[L.n]. 
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By Equation [6] we have 



log«Dij > log(i£)j - c\ogiD,j) > - logiD,j- 



(9) 



Similarly Equation [7] yield 
and since D' = N o D 
Thus for almost every j 



logio'j < 2logiD2,j- 



(10) 
(11) 



iD',j - lD,j > iD2,j - lD,j - '2c\ogiD2,j 

ioij - 2c\ogiD2,j - clogiDj 
iDj_,j - 2clog«D2,i - 2clogiDi,j 
iDij - 2clogZ£)2,j - 4clogi£)2,j 

> (6 - 6c) logiDaj 

> {b-6c)/2logiD',j 

> a log ijji J 



> ^D2,j 

> ^D2,j 

> ^D2,j 



by Equation [8] 
by Equation [6] 
by Equation 

by Equation [TD] 
by depth of S 

by Equation [11] 
by definition of b 



i.e. T is deep. □ 
Proof, (of Theorem 14. 4p As shown in [8] polynomial compression yields an alternative char- 
acterization of resource-bounded measure zero sets. Resource-bounded measure is a measure 
theory within the complexity class E developed by Lutz [H], which is obtained by impos- 
ing polynomial resource-bounds on a game theoretical characterization of classical Lebesgue 
measure, via martingales. A martingale is a function d : {0, 1}* — )• M+ such that, for every 
w £ {0, 1}*, 2d{w) = d{'wO) + d{wl) . This definition can be motivated by the following betting 
game in which a gambler puts bets on the successive membership bits of a hidden language 
A. The game proceeds in infinitely many rounds where at the end of round n, it is revealed to 
the gambler whether s„ € vl or not. A polynomial (computable) martingale is a martingale 
computable in time polynomial in the input size. 

In [8j the following equivalence between polynomial martingales and monotone compres- 
sion was shown. 

Lemma A. 2 Given a polynomial computable martingale d, and a sequence w, there exists a 
Poly- compression (C, D) for w such that for any j G N 

iD,j - j > logd{w[l..iD,j]) - 4. 

Alternatively given a Poly-compression (C, D) for w, there exists a polynomial martingale d 
such that for any j € N 

\ogd{w[l..iD,j]) > iDj - j - 2. 

It was shown in [14J that for every /c € N there exists a n'^-universal martingale d^ computable 
in polynomial time, such that for any martingale d computable in time n^, there exists c > 0, 
such that for any w G {0, 1} 

dkiw) > c • d{w). 
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The sequence S = SIS1S2 ■ ■ ■ S{ . . . is constructed by induction, where \Si\ = 1 and 
l^^l = MD(MD(|S' 1 /S^D), and 5[ diagonahzes against dj. (i.e. dk does not increase on S'[); 
more precisely, define S^. by induction, where for every t e {0, . . . , - 1}, the next bit 
6 G {0, 1} of Sl is chosen such that 

dk{{S]Si)Si[0..t]b)<dk{{S]Si)Si[0..t]). 

We need the following lemma. 

Lemma A. 3 For any k,l G (k < I), there exists j = j{k,l) E N such that for any Poly- 
compression (C, D) for S 

^\S]Si\<iD,j < \s\si\. 

Let us prove the lemma, wlog (by ignoring the decompressors that do not output at least n 
bits from a program of size 2n) for any Poly-compression (C, D) and for almost every j € N, 

j/2 < iDj < MD(j). 

Letting b = \S ] Sl\ and j = MD(6) yields 

iD,j > i/2 = MD(6)/2 > 36 

and 

iD,j < MD(j) = MD(MD(6)) = \Si\ < \S \ Si\ 

which ends the proof of the lemma. 

Let us show that S is monotone-Poly-deep. Let (C, D) be a Poly-compression of S, and 
let a > 0. By Lemma \A.2\ let d be a Poly martingale s.t. for any j G N 

log d{w[l..iD,j]) > iD,j - J - 2 

and suppose d runs in time n'^. Thus there is a c > such that cd^iw) > d{w) for any string 
w. Let j be given by Lemma lA.31 By definition of S^, d^ does not increase on it; as d^ can 
at most double its capital on every bit of S 1 S^., and by Lemma IA.3I we have 

iD,j - j - 0(1) < logdk{S[l..tDj]) < \S 1 Si\ < iD,j/3 

i.e. 

iD,j < 3j72 + 0(1) 

where the constant 0(1) does not depend on j. 

Consider the following Poly-compression {C',D',p) for S. Informally D' reconstructs 
S^. using dk- Program p is equal to S, except on blocks Sj, (for every / G N), where p is 
j' = j{k,l) — \p ] S^l zeroes, i.e more formally 

p = SlSfS2 . . . S[. . . S{_iO^ '-'^''^S'fc+i . . . sl- 

Since it is easy to compute the sizes of the blocks S'[, it is easy to determine where each 
block starts and stops in p. D' on input a prefix of p' of p with \p'\ = j{k, I), can reconstruct 
the parts in S not in an S'[, (/ G N) block, by just reading p'. The ending of p' (which 
corresponds to an S^, block), consists of j'{k,l) zeroes. On every such zeroes except the 
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last one, D' outputs one bit of S"^ (reconstructed using dk). On the last zero, D' outputs 
MD(j) - i' + 1 bits of S{. After the last zero, D' will have output MD(j) bits of Sl, i.e. will 
have output exactly all bits of 5^, and we have 



iD',j = MD(j). 

The definition of C is trivial and left to the reader. We have 

iD',j - ioj = MD(j) - iDj 

> MD(j) - 3j/2 - 0(1) 

> alogMD(j) 

> a logic J. 

Since there are infinitely many j = k) (one for every I > k), S is deep. □ 
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